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Abstract 

The distance between a pair of spike trains, quantifying the differences be- 
tween them, can be measured using various metrics. Here we introduce a new 
class of spike train metrics, inspired by the Pompeiu-Hausdorff distance. Some 
of our new metrics (the max-metric and the modulus-metric) are sensitive to 
differences in the precise timings of spikes in the considered spike trains that 
cannot be discriminated by existing metrics like the van Rossum distance or 
the Victor & Purpura distance. The modulus-metric does not depend on any 
parameters and can be computed using a fast algorithm, in a time that de- 
pends linearly on the number of spikes in the two spike trains. We also intro- 
duce localized versions of the new metrics, which could have the biologically- 
relevant interpretation of measuring the differences between spike trains as 
they are perceived at a particular moment in time by a neuron receiving these 
spike trains. 

1 Introduction 

In recent years several spike train distances, some inspired by existing mathemati- 
cal distances while others not, have been proposed and used to measure the vari- 
ability of the neural activity (Victor and Purpura, 1996, 1997; van Rossum, 2001; 
Victor, 2005; Schrauwen et al., 2007; Naud et al., 2011). The distance between two 
spike trains reflects their similarity or dissimilarity. Because how information is 
represented in the spatio-temporal patterns of spike times exchanged by neurons 
is still a heavily debated topic in neuroscience, metrics based on different neural 
codes are available. Traditionally it was thought that mean firing rate of neurons 
encapsulated all the relevant information exchanged by neurons. This idea dates 
back to the work of Adrian (1926) who showed that the firing rate of motor neu- 
rons is proportional to the force applied. More recently, scientists have revealed 
increasing evidence of the importance of precise spike timings to representing in- 
formation in the brain (Bohte, 2004; VanRullen et al., 2005; Tiesinga et al., 2008). 
For example, temporally-structured multicell spiking patterns were observed in the 
hippocampus and cortex, and were associated to memory traces (Nadasdy et al., 
1999; Ji and Wilson, 2007) while the coding of information in the phases of spikes 
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relative to a background oscillation has been observed in many brain regions (Lee 
et al., 2005; Jacobs et al., 2007; Fries et al., 2007; Montemurro et al., 2008; Siegel 
et al., 2009). This change in viewpoints from rate codes to spike-time codes is also 
reflected in spike train metrics. 

The most basic metrics are the ones that rely on counting the total number 
of spikes within a spike train. A major drawback of such an approach is that all 
the temporal structure is lost. Even though binning techniques were introduced 
as a way to overcome this loss by dividing the spike train into discrete bins, the 
temporally-encoded information within a bin was neglected (Geisler et al., 1991). 
Other, more complex spike train metrics can be obtained by focusing on the pre- 
cise spike timing instead of their total count. One example is the van Rossum 
(2001) distance which is calculated by filtering the time series corresponding to 
the raw spike train with a smoothing kernel and then using the standard Euclidean 
distance. The choice of kernel is arbitrary and has a high influence on the proper- 
ties of the metric. 

Another metric was introduced by Victor and Purpura (1996, 1997). According 
to this metric, the distance between two spike trains is given by the minimum cost 
of basic operations needed to transform one spike train into the other. The basic 
operations are insertion or deletion of spikes, with a cost of 1, and the shifting of 
a spike, with a cost of q\8t\ where q is a parameter and St the shifting interval. 
The parameter q clearly influences the behavior of the metric: for q — the metric 
counts the difference in the total number of spikes, while for large values of q the 
metric returns the number of non-coincident spikes. 

Both the van Rossum metric and the Victor & Purpura metric were extended to 
multi-neuronal cases (Houghton and Sen, 2008; Aronov et al., 2003) to enable the 
analysis of pattern activity across multiple neurons. 

Here we introduce a new class of spike train metrics inspired by the Pompeiu- 
Hausdorff distance between two non-empty compact sets (Pompeiu, 1905; Haus- 
dorff, 1914). The new spike train metrics yield a result dependent of the exact tim- 
ing of differences among two spike trains. In the context of the information ex- 
changed by two neurons, each spike may be as important as the spike train itself 
(Rieke et al, 1997). Therefore, such metrics, based on the specific timing of differ- 
ences within spike trains, become desirable. 

Preliminary results have been presented in abstract form in (Rusu and Florian, 
2010). 

2 A new class of spike train metrics 

We consider bounded, nonempty spike trains of the form 

r = {t a \...,t [n) }, (i) 

where f (l) e U are the ordered spike times and zz e N* is the number of spikes in 
the spike train. We consider spike trains with no overlapping spikes, f w ^ 

e {l,...,n}, i ^ j. If n> 1, then f (i_1) < f (,) , Vz > 1. We denote by a and b some 
bounds of the considered spike trains, i.e. a < v- 1 ' < b, Vf (i) , with a, b £ U, finite, 
and a < b. We denote by S^[ a ,b\ the set of all possible such spike trains bounded by 
a and b. We study metrics that compute the distances between two spike trains T 
and f from Sf\ a ,b\ ■ 
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The new metrics that we introduce are inspired by the Pompeiu-Hausdorff dis- 
tance (Pompeiu, 1905; Hausdorff, 1914). When applied to a pair of spike trains, the 
Pompeiu-Hausdorff distance h returns the largest difference, in absolute value, be- 
tween the timing of a spike in one train and the timing of the closest spike in the 
other spike train: 



h(T, T) = max< sup inf \t- t\, sup inf \t- t\ >, (2) 

tET KT - t£ f teT 

or, equivalently, the minimal number e > such that the closed e-neighborhood of 
T includes f and the closed c-neighborhood of T includes T: 

h{T, t) = inf{e such that \t- t\ < e, Vf e T, Vf e T } . (3) 

Another equivalent form of the Pompeiu-Hausdorff distance is the following (Pa- 
padopoulos, 2005, pp. 105-110; Rockafellar and Wets, 2009, pp. 117-118; Deza and 
Deza, 2009, pp. 47-48): 



h[T, T) = sup 



inf \ t — x\ — inf \ t — x\ 

KT tef 



(4) 



We introduce a distance d between an arbitrary timing x e R and a spike train 



d[x,T) = ia£\t-x\. (5) 



Eq. 2 can then be rewritten as 



h{T, T) = max-; sup d[t, T), sup d{t, T) \ (6) 
and Eq. 4 as 

h(T,T) = sup\d{x,T)-d(x,T)\. (7) 

jceR 

We also have (Appendix A): 

h{T,T)= sup \dtx,T)-d(x,T)\. (8) 

xE[a,b] 

The Pompeiu-Hausdorff metric has a quite poor discriminating power, as for many 
variations of the spike trains the distances will be equal and any spike train space 
endowed with this metric would be highly clusterized. Our new metrics generalize 
the form of the Pompeiu-Hausdorff distance given in Eq. 8, by introducing features 
that are more sensitive to spike timings. 



2.1 The max- metric 

We consider B to be the space of all continuous, positive functions J€ : [0,b- a] — » 
IR + that satisfy the condition, Vwe [a, b], 

f ^f(|M-s|)ds>0. (9) 

J a 



3 



Because 



rb nil rb 

I jtf(\u-s\)ds= I je{u-s)As+\ Je{s-u)ds (10) 

J a J a Ju 

J^u—a rb—u 
je{s)ds + I Je{s)ds, 
o Jo 



(11) 



and because J€ is continuous, a sufficient condition for satisfying Eq. 9 is that 
J€ (0) > 0. On compact sets, continuous functions are bounded (Protter, 1998, p. 
56). We denote by m the upper bound of J€ on the interval [0, b- a], i.e. 

0<jfW<m<oo > Vxe[O l h-fl]. (12) 

In typical applications, J€{x] has a maximum for x — and is a decreasing 
function of x, for example an exponential, 

je E (.x) = - exp(-~), (13) 

or a Gaussian, 

tV2u \ 2t 



je G w = ex P["^ - (14) 



with t a positive parameter. 

We introduce the max-metric as 

rb 

d m [T,T)= I sup {\d{x,T)-d{x,T)\Je{\s-x\)}&s. (15) 
Ja x£[a,b] 

The max-metric integrates, through the variation of s along the interval [a, b] that 
contains the two spike trains, the maximum of the difference, in absolute value, be- 
tween the distances from a point x in that interval to the two spike trains, weighted 
by the kernel 3€{\s- x\) which focuses locally around 5. Figure 1 shows how the 
distance between two spike trains is computed using the max-metric. 

The max-metric is a generalization of the Pompeiu-Hausdorff distance, since 
in the particular case that = l/[b- a) we have d m [T,f)-h[T,t). 

In Appendix B we show that d m is finite and that it satisfies the properties 
of a metric. We also show that regardless of the kernel J€ all the max-metrics 
are topologically equivalent to each other (O'Searcoid, 2007, p. 229) because they 
are equivalent to the Pompeiu-Hausdorff distance. Each metric will generate the 
same topology and thus any topological property is invariant under an homeo- 
morphism. This means that the metrics generate the same convergent sequences 
in the space of spike trains £^\ a ,b\- Thus, learning rules derived from these metrics 
will converge in the same way, regardless of the choice of J€ . 

2.2 The modulus-metric 

We define the modulus-metric as 



■ f \d(s, 
Ja 



d (T,T)= I \d(.s,T)-d(s,T)\ds. (16) 
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Figure 1: The modulus-metric and the max-metric. (A) Spike train T = 
{20,150,350,400,440} ms. Each spike time is represented as a vertical bar. (B) 
Spike train f = {100,270,300,370,480} ms. (C) The distance between a timing 
x and the spike trains d{x, T) and d{x, T), as a function of x. (D) The differ- 
ence \d{x, T) - d[x, T)\ as a function of x. The modulus -metric distance d {T, f) 
is the area under this curve. (E) The kernel JC(\s— x\) as a function of s with 
a fixed x - 250 ms. J€ is an exponential (Eq. 13) with a decay constant 
t = 50 ms. (F) The weighted difference \d(x, T) - d{x, t)\ J€ [\s - x\) as function 
of s for discrete values of x. (G) The supremum of the weighted difference, 
su Px€[a,b\ {\d{x, T) - d{x, f )| ^f(|s- x\)\, as a function of s. The max-metric dis- 
tance d m {T, t) is the area under this curve. 
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Figure 2: The convolution max-metric. (A) Spike train T = {20,150,350,400,440} 
ms. Each spike time is represented as a vertical bar. (B) Spike train f = 
{100,270,300,370,480} ms. (C) The spike trains T and T filtered with an exponen- 
tial kernel (Eq. 19) with a decay constant t = 10 ms. (D) The difference \f{x) - f{x) | 
as a function of x. (E) The kernel 3€{\s- x\) as a function of s with a fixed x = 250 
ms. J€ is an exponential (Eq. 13) with a decay constant t = 50 ms. (F) The 
weighted difference \ f{x) - f{x)\ 3€ (|s- x\) as function of 5 for discrete values of x. 
(G) The supremum of the weighted difference, sup xe[a fo] - f{x)\ J€ Qs- x\)}. 

The convolution max-metric distance d c {T, T) is the area under this curve. 
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Figure 1 A-D shows how the distance between two spike trains is computed using 
the modulus-metric. The modulus-metric is a particular case of the max-metric in 
the limit that J€ is 

fl, if x = 0, 
J€{x) = \ . (17) 

[ 0, otherwise. 

The modulus-metric does not depend on any kernels or parameters and it also 
allows a fast computer implementation in linear complexity. This is because the 
graph of the function cp{s) - \d{s, T)-d{s, T)\ is made out of line segments that join 
or end in the following points: all timings of spikes in the two spike trains T and f; 
the time moments that lie at the middle of the interval between two neighboring 
spikes from the same spike train; the time moments that lie at the middle of the 
interval between a pair of neighboring spikes where the two spikes belong to dif- 
ferent spike trains; and the bounds a and b. This is exemplified in Figures 1 D and 
3 D. We denote by £? the set of these points. In order to compute the integral of 
this function d = (pis) ds, it is sufficient to compute the function at the points 
from 3?. Since between these points the function is linear, the integral can be then 
computed exacfiy. 

Algorithm 1 presents a quick-and-dirty implementation of the d metric in pseudo- 
code. In this algorithm, the function (p is computed in a set of points that includes 
9 but also other points. 

In the optimized Algorithm 2, the set as well as the value of <p in the points of 
& is computed with a single pass through the spikes in the two spike trains. The 
algorithm's duration depends linearly on the number of spikes in the two spike 
trains, n + n. A Python implementation of this optimized algorithm is freely avail- 
able at https://github.com/modulus-metric/. 

It can be shown that the distance d Q is finite and that it satisfies the properties 
of a metric by particularizing the proofs in Appendix E with 5£ (x) = 1, Vx e IR. 

2.3 The convolution max-metric 

The max-metric can also be given in a convolution form. To construct this form of 
the metric we consider an arbitrary continuous, smooth, positive kernel J£ : R — » 
U + , with the properties that it is strictly increasing for x < and strictly decreasing 
for x > and that 

< Jf(x) < p for every xel, and JfT(O) > 0, (18) 
where p is a positive, finite bound. Typically, J£f is an exponential, 

Jfr £ M = exp(-y), (19) 

with t being a positive parameter. We convolve the two spike trains T and f with 
the filtering kernel J£ to obtain 



/(*) = £^(x-r m ) (20) 



/(*) = £j£T(x-f (i) ). (21) 
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Input: The pair of nonempty spike trains T\, T2 and the bounds a and b. 

Output: The distance d (T\, T2) between the spike trains. 

(T\, T2 and P are ordered sets of real numbers, indexed starting from 0.) 

n\ := length(Ti); «2 := length(T2); 

P:=sort(ri U T 2 ); 

M:=0; 

for i := \ ...n\ - 1 do 
L M:=AfUKri[i] + ri[i-l])/2}; 

for i := 1 ... ri2 - 1 do 

L M:=MUf(r 2 [f] + r 2 [i-i])/2]; 

for / := 1 . . . length(P) - 1 do 
|_ M:=M \J{{P[i] + P[i-l])l2}; 

P:=sort(PU M\J{a,b}); 
d := 0; i\ := 0; 12 := 0; 

(s is the currently considered point from P. <p is the value at s of the integrated 
function \d(s, T\] - d(s, T 2 )\. s p is the previously considered point from P, and (f>p is 
the value at s p of the integrated function. i\ is the index of the first spike in T\ 
having a timing that is greater than s, if there is such a spike, or the index of the last 
spike of T\, otherwise. i 2 is computed analogously for T 2 .) 
s p :=a; <p p := | T x [0] - T 2 [0]|; 
for / := 1 . . . length(P) - 1 do 
s:=P[i]; 

while s>T\ U'i] and i\ < n\ - 1 do 

|_ ii := ii + 1; 

while s> T 2 [i2\ and i 2 < «2 - 1 do 

|_ i 2 :=i 2 + l; 

d\ := b- a; d 2 ~ b - a; 
if i\ > then 

|_ di:=s-ri[ii-l]; 

4 = |Ti[ji]-s|; 
if d' x < d\ then 

|_ di:=d[; 

if 12 > then 

|_ d 2 := s-T 2 [i 2 -l]; 

d' 2 = \T 2 [i 2 ]-s\; 
if d' 2 < d 2 then 

I d2 := d'2, 

<We now have d\ = d(s, Ti) and d2 = d(s, T2) and we can compute the value of <p 
at s:) 

(j) := \d\ - d2\; 

(The integration is performed here:) 
d \- d + (s- s p ) {(f) + (pp)l2; 
Sp := s; (p p := (j>; 

return d ; 

Algorithm 1: A quick- and- dirty algorithm for computing the modulus-metric 
distance d between two spike trains T\ and T 2 . The text surrounded by (...) 
represents comments. 
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Input: The pair of non-empty spike trains T\, T2 and the bounds a and b. 
Output: The distance d (T\, T2) between the spike trains. 

(T\ and T2 are ordered sets of real numbers, indexed starting from 0. i\ and i 2 are 
the indices of the currently processed spikes in the two spike trains. p\ and P2 are 
the indices of the previously processed spikes in the two spike trains, p is the index 
of the spike train to which the previously processed spike belonged (1 or 2), after at 
least one spike has been processed, or otherwise.) 
i\ := 0; 12 := 0; p\ := 0; P2 := 0; p := 0; 
n\ := length(Ti); «2 : = length^); 

(P is an array of structures (s,(p) consisting of a ordered pair of numbers.) 
P:={(s~a,0~Ui[O]-r 2 [O]|)}; 

(Process the spikes until the end of one of the spike trains is reached.) 
while i\ < n\ and 12 < «2 do 
if 7i[/i]< T 2 [i 2 ] then 
I procl(l,2); 

else 

|_ procl(2, 1); 

(Process the rest of the spikes in the spike train that has not been fully processed.) 
while i\ < n\ do 
|_ proc2(l, 2); 

while ?2 < «2 do 

|_ proc2(2, 1); 

P--P\j{(s-b,<p-\T 1 [ni-l]-T 2 ln2-l]\)}; 

(Sort P. Elements of P are sorted according to their value of s.) 

P:=sort(P); 

(Perform the integration.) 
d := 0; 

for / := 1 . . . length(P) - 1 do 
|_ d :=d + (P[i].s-P[i-l].s)(P[i].(l>+P[i-l].<l>)l2; 

return d ; 

Algorithm 2: An optimized algorithm for computing the modulus-metric dis- 
tance d between two spike trains T\ and T 2 . The text surrounded by (...) repre- 
sents comments. 
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Input: The indices j and k of the two sorted spike trains Tj, T k ; j, ke {1,2}, j ^ k. 

Data: Uses as global variables: the indices ij, i k of the current spikes in the two spike 
trains; the indices pj, p k of the previously processed spikes in the two spike 
trains; the index p of the spike train to which the previously processed spike 
belonged (1 or 2; if no spike has been previously processed, p = 0); the data 
structure P. We should have here Tj [ij] < T k [i k ]. If p ^ 0, we should have 
Tp[i p ]<T } [ij]. 

Result: Performs part of the processing needed for creating P. The procedure is used 

when processing has not reached the end of one of the spike trains, 
if ij > then 

(Adds to P the timing situated at the middle of the interval between the currently 
processed spike and the previous spike in the same spike train.) 
t:={Tj[ij] + Tj[ij-l])/2; 

(We have d(t, Tj) = Tj [ij] -t=t-Tj [ij - 1] = [Tj[ij] - Tjlij - l])/2.) 
P*PU{[*-t.*-\lTj [ij] - Tj [ij - l])/2) - d{t, k, i k ) |)}; 
if p = k then 

(If the previously processed spike was one from the other spike train than the 
spike currently processed, adds to P the timing situated at the middle of the 
interval between the currently processed spike and the previously processed 
spike.) 

t:=(Tj[ij] + T k [p k ])/2; 

(Since t is at equal distance to the closest spikes in the two spike trains, Tj[ij] 
and T k [p k ], we have d{t, Tj) = d(t, T k ) and (p(t) = 0.) 
P:=P\j {[s~ t,4>~0)}; 

(Adds to P the currently processed spike.) 
t:=Tj[ij]; 

(We have d(t, Tj) = 0. If at least one spike from T k has been processed, we have 
r fc[Pfc] s * s T k\-h\> wi th ifc = Pk+ 1. and thus d(t, T k ) = min(| t- T k [p k ]\, T k [i k ] - t). 
If no spike from T k has been processed, we have p k = i k = 0, and the previous 
formula for d(t, T k ) still holds.) 
P:=P\j{{s-t,<p-mm(\t-T k [p k ]\, T k [i k ] - t))}; 

Pj- =i r 

ij := + 
p ~ j; 

Procedure proclQ', k). 
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Input: The indices and k of the two sorted spike trains Tj, T k ; j,ke {1,2}, j ^ k. 

Data: Uses as global variables: the index ij of the current spike in Ty, the index p k of 
the previously processed spike in T k ; the index p of the spike train to which 
the previously processed spike belonged (1 or 2); the data structure P. Here, p k 
should be the index of the last spike in spike train T k . We should have 
T k [p k ]<Tj[ij]. 

Result: Performs part of the processing needed for creating P. The procedure is used 

when processing has reached the end of spike train T k . 
if ij > then 

(Adds to P the timing situated at the middle of the interval between the currently 
processed spike and the previous spike in the same spike train.) 
f-{Tjlij] + Tjlij-l])l2; 

(We have d(t, Tj) = Tj [ij] -t=t-Tj [ij - 1] = [Tj[ij] - TjUj - l])/2.) 
P:=PU{(s»f,(/>» - Tjlij - l])/2)-d{t,k,p k )\)}; 

if p = k then 

(If the previously processed spike was one from the other spike train than the 
spike currently processed (i.e., the last spike in the spike train that has been fully 
processed), adds to P the timing situated at the middle of the interval between 
the currently processed spike and the previously processed spike.) 
t:={Tj[ij] + T k [p k ])l2; 

(Since t is at equal distance to the closest spikes in the two spike trains, Tj [ij] 
and T k [p k ], we have d{t, Tj) = d(t, T k ) and (p(t) = 0.) 
_ P:=P\j {(s~ t,4>~0)}; 

( Adds to P the currently processed spike. ) 
t:=Tj[ij]; 

( We have d{t, Tj) = 0. We have T k [p k ] < t and the spike at p k is the last one in T k , 

and thus d(t,T k ) = t-T k [p k ].) 

P:=P\j{{s-t,<p-t-T k [p k ])}; 

ij := + 

p ~ j; 

Procedure proc2(;', k). 
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Input: A timing t, the index k e {1, 2} of a sorted spike train Tj-, and the index i of a 
spike in 7^, such that either f < T k [i] or £ is the index of the last spike of T k . 
Output: The distance d(t, T k } between the timing t and the spike train T^. 
d:=\T k [i]-t\; 
j:=i-l; 

while j > and | T k [j] - t\ < d do 
d:=\T k lj)-t\; 
_ /:=/-!; 
return d; 

Function d(f, k, i). 

We denote by &[ a ,b] the set of all possible filtered spike trains from £f\ a ,b\- 

We also consider a function J€ e IB that is stricdy positive, that is derivable on 

(0, b - a) and that has a bounded derivative. 
The convolution max-metric is defined as 

r b 

d c {T,T)=\ sup {\f{x)-f{x)\M'{\s-x\)}As. (22) 

Ja x£[a,b] 

Figure 2 shows how the distance d c between two spike trains is computed. In Ap- 
pendix C we show that d c is finite and that it satisfies the properties of a metric. 

3 Localized metrics 

In the case of the max metric, with or without convolution, the use of the kernel 
JC served the purpose of providing a local perspective, around each point within 
[a, b], of the distance between the spike trains. These local perspectives were then 
integrated in the final distance. In this section we introduce different metrics that 
also depend on a kernel !£, but for which the kernel has a different purpose. More 
precisely, the kernel may be regarded as a magnifying glass to be used to focus on 
one specific area of the spike trains. The kernel should be a continuous, positive 
function, 5£ : [0, b - a] U + , such that 

5£{x) >0, Vxe [0,b-a]. (23) 

As J€, because if is a continuous function with bounded support, it is bounded, 
i.e. 

0< if(x) < m<oo, V xe [0,b-a]. (24) 

Such a metric is biologically relevant if, for example, we take into consideration 
how a neuron responds to input spikes. Recent spikes influence more the neuron 
than old ones. If we would like to measure the distance between two spike trains 
according to how the differences between them influence the activity of a neuron 
at a particular moment of time, recent differences should be taken into account 
with a greater weight than differences in the distant past. For the localized metrics, 
5£ could thus model the shape of postsynaptic potentials (PSP) that reflects the 
dynamics of the effect of one presynaptic spike on the studied neuron. Thus, 5£ 
could typically be an exponential, i?£ = J€e (Eq. 13), an alpha function, 

x i x\ 

S£ a {x)= ^ exp(--J, (25) 
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a difference between two exponentials, 



exp | — j - exp 



(26) 



or, if we model the postsynaptic potential generated in an integrate-and-fire neu- 
ron by a synaptic current that is a difference between two exponentials, 



T-T s 
T - T r 



exp 
exp 



exp 
exp 



x 

X 
tr 



(27) 



where t, t s , and T r are positive parameters. 

3.1 Localized max- metric 

We introduce the localized max-metric as 



di(T,t)= f ££(b-s) sup \d{x,T)-d{x,f)\As. 

Ja x£[s,b] 



(28) 



Figure 3 shows how the distance di between two spike trains is computed. The dif- 
ferences between the spike trains that account the most for the distance are those 
that are close to b. The shape of 5£ has a high impact on the behavior of the metric. 

In Appendix D we show that the distance d\ is finite and that it satisfies the 
properties of a metric. 

3.2 Localized modulus-metric 

The modulus metric can also be given in a localized form: 



d n (T,f) 



f 

J a 



\d(s, T)-d{s, f)\££{b-s) As. 



(29) 



In Appendix E we show that d n is finite and that it satisfies the properties of a 
metric. 



3.3 Localizing the van Rossum metric 

A localization by a kernel i£ similar to the one we applied in Eqs. 28 and 29 can 
also be applied to existing metrics. Let T, T e £P[ a ,b\ ■ Consider the van Rossum 
(2001) distance defined as 

(g(s)-g(5)) 2 ds, (30) 

-oo 

where 

n 

g(s) = ^H(j-^' ) )Jfe£(s-f (i) ) (31) 
i=i 

g(s)= j^H{s-t {i) ) J?f £ (5-r w ), (32) 
i=l 
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Figure 3: The localized max-metric. (A) Spike train T = {30,190,200,320,410,480} 
ms. Each spike time is represented as a vertical bar. (B) Spike train f - 
{20,120,200,300,350,460} ms. (C) The distance between a timing x and the spike 
trains d{x,T) and d{x,f) as function of x. (D) The difference \d{x, T) - d[x, f)\ 
as a function of x. (E) The supremum, sup^rj w \ d{x, T) - d{x, T)\. (F) The kernel 
5£{b- s) as function of s, an exponential (Eq. 13) with a decay constant t = 50 ms. 
(G) The supremum weighted by the kernel, ££{b - s) sup^^ u \d(x, T) - d[x, T)\, as 
a function of s. The localized max-metric distance di{T, f) is the area under this 
curve. 
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H is the Heaviside step function, H[x) — if x < and H{x) — 1 if x > 0, and is 
defined in Eq. 19. When localized with 5£ the distance becomes 



dmiT, t) = I (g(s) - g(s)) 2 s) ds. 



(33) 



J—oo 



Here Jz? may be chosen to have the same qualitative properties as the kernels used 
in Eqs. 25-27. 

4 Simulation results 

We analyzed the behavior of the introduced metrics through computer simulations 
using simple setups. Across all simulations, J€ was an exponential (Eq. 13) with 
t — 10 ms. For the localized metrics d\ and d n , ££ also was an exponential (Eq. 13) 
with t = 20 ms. The convolution kernels for the d c and van Rossum distances were 
chosen as exponentials (Eq. 19) with r — 10 ms. For the Victor & Purpura distance 
we set q — 0.1 ms -1 . We set a — ms and b the maximum length of spike trains 
(either 200 or 500 ms). 

First, we computed the distances between a particular spike train T and a spike 
train f obtained from it by either inserting or shifting one spike. In the insertion 
case, T was generated by inserting a spike into T at various timings. In the shifting 
case, T was generated by shifting a particular spike of T. The distance was plotted 
against the time of the inserted spike or of the shifted spike to see how the change 
is reflected by the metrics. To compute the distance we used the introduced met- 
rics, a simple spike count distance (c), the Pompeiu-Hausdorff distance [h) and the 
Victor and Purpura (1996, 1997) {dyp) and van Rossum (2001) (4r) distances. We 
used b = 200 ms. The spike count distance is defined as 



where n and n are the number of spikes in each train. 

The results for the insertion case are presented in Figure 4. The Victor & Pur- 
pura distance was constant since the cost of adding and removing a spike is fixed 
at 1 regardless of its timing. Similarly, the van Rossum metric was insensitive to 
the time of the inserted spike, a result which can be also shown analytically (van 
Rossum, 2001). The spike count distance remained constant regardless of where 
the spike was inserted. The results were qualitatively different in the case of our 
newly introduced distances, with the exception of the convolution max-metric, 
showing how they depend on the spike time differences across spike trains. In the 
case of the Pompeiu-Hausdorff distance, max-metric, modulus-metric, and of the 
localized variants of the max-metric and the modulus-metric, the insertion time of 
the spike had a significant impact on the outcome (Figure 4). It can also be seen 
that the localized distances were strongly influenced by the shape of the 5£ kernel. 

The results for the shifting case are presented in Figure 5. When the spike at 
f t4) was shifted, the Victor & Purpura and van Rossum distances were dependent 
only on the width of the shifting interval. These results are confirmed by analytical 
derivations (Victor and Purpura, 1996; van Rossum, 2001). As in the previous case, 
the spike count distance was insensitive to the shift operation and remained zero 
since the number of spikes did not change. In contrast, our newly introduced dis- 
tances, with the exception of the convolution max-metric, showed a dependence 



c{T, T) = 



\n— n\ 



(34) 



max(Ai, ri) ' 
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not only on the width of the shifting interval but also on the particular timing of 
the shifted spike. 

Second, we explored the correlation between the newly introduced metrics and 
the classical Victor & Purpura and van Rossum distances. We generated a 500 ms 
Poisson spike train with a firing rate of 20 Hz. From this spike train, we generated a 
new one by adding a Gaussian jitter with zero mean and 20 ms. We considered only 
generated and jittered spike trains that contained 10 spikes. We then measured the 
distance between the original and the jittered spike train using various metrics. We 
repeated this for 5,000 samples, where for each sample the original spike train and 
the jitter were generated randomly. The results are displayed in Figure 6. Table 1 
shows the correlation coefficients between the max-metric, the modulus-metric, 
the convolution max-metric and, respectively, the van Rossum and Victor & Pur- 
pura distances. 

Table 1: Correlation coefficients between the introduced distances and, respec- 
tively, the van Rossum and Victor & Purpura distances, computed from data pre- 
sented in Figure 6. 



Distance 


dR correlation coefficient 


dyp correlation coefficient 


dm 


0.5391 


0.6677 


d 


0.5405 


0.6512 


d c 


0.8450 


0.9535 


d R 


1.0000 


0.8475 


d VP 


0.8475 


1.0000 



5 Discussion 

The max-metric and the modulus-metric can discriminate differences in the pre- 
cise timings of individual spikes that are not discriminated by the classical van 
Rossum and Victor & Purpura distances (Figures 4, 5). The max-metric and the 
modulus-metric have qualitatively similar properties. While the max-metric de- 
pends on a kernel J€ which can be particularized to cause distinct behaviors, and 
the van Rossum and Victor & Purpura distances also depend on parameters that 
must be chosen by their users, the modulus-metric does not depend on any pa- 
rameters. We have also shown that the modulus-metric can be computed through 
a fast algorithm that operates in a time that depends linearly on the number of 
spikes in the considered spike trains. 

The convolution-metric that we introduced, although analytically similar to the 
max-metric, is qualitatively similar to the van Rossum distance. A qualitative differ- 
ence between the convolution-metric and the van Rossum distance appears when 
the differences between the spike trains are localized near the ends of the inte- 
gration interval, and this is a simple consequence of the difference between the 
bounded integration interval for the convolution-metric and the infinite integra- 
tion interval for the van Rossum distance. 

We have considered only spike trains having non- overlapping spikes. If we re- 
lax this constraint, for our newly introduced distances, with the exception of the 
convolution max-metric, we get a zero distance between a spike train and a sec- 
ond one generated from the first by adding an extra spike to the first, overlapping 
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Figure 4: Metric comparison. We computed the distance between the spike train 
T = {20,50,75,125,180} ms and one obtained from this spike train by inserting a 
spike at different locations. At each time 5 = 0...200 ms a spike was inserted to 
generate f and the distance between T and f was computed and plotted against 
s. (A) The spike train T. (B) The van Rossum distance. (C) The Victor & Purpura 
distance. (D) The spike count distance. (E) The Pompeiu-Hausdorff distance. (F) 
The max-metric. (G) The convolution max-metric. (H) The modulus-metric. (I) 
The localized max-metric. (J) The localized modulus-metric. 
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Figure 5: Metric comparison. We computed the distance between the spike train 
T = {10,50,75, 125, 150} ms and one obtained from this spike train by shifting the 
spike at ? (4) = 125 ms. The spike was shifted at timings s = 0...200 ms to gener- 
ate f and the distance between T and T was computed and plotted against 5. (A) 
The spike train T. (B) The van Rossum distance. (C) The Victor & Purpura dis- 
tance. (D) The spike count distance. (E) The Pompeiu-Hausdorff distance. (F) The 
max-metric. (G) The convolution max-metric. (H) The modulus-metric. (I) The 
localized max-metric. (J) The localized modulus-metric. 



18 




Figure 6: Correlations between the distances computed with our newly introduced 
metrics and, respectively, the Victor & Purpura (left column) and the van Rossum 
(right column) metrics. A 20 Hz Poisson spike train was generated over 500 ms and 
then jitter drawn from a Gaussian distribution with zero average and 20 ms vari- 
ance was applied to it. The distances between the original and jittered spike train 
were then computed. The process was repeated 5,000 times. All distances were 
normalized to the mean value across samples. (A) Max-metric. (B) Convolution 
max-metric. (C) Modulus-metric. (D) Victor & Purpura / van Rossum. 
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an existing spike (Figure 4). This is due to the distance d between an arbitrary 
timing and a spike train in Eq. 5 which does not distinguish between overlapping 
spikes in a train. Thus, if we relax the constraint of not allowing non-overlapping 
spikes, these distances became pseudo-metrics because we can have zero distance 
between two spike trains that differ through overlapping spikes. However, the case 
of overlapping spikes is biologically implausible if we consider spike trains fired by 
single neurons. If it is enough that the distances are pseudo-metrics, we may also 
relax some of the conditions of the kernels, such as the requirement for Jz? to be 
strictly positive on (0, b— a] or the conditions on J£ . 

For our metrics, when the integrating interval [a, b] extends beyond the inter- 
val covered by extremes of the spike trains, e.g. [min(Z" (1) , max(f (n) , f (n) )] for 
a pair of spike trains, the result of the integration in the area not covered by ex- 
tremes of the spike trains adds to the distance without contributing information 
about the spike trains. Thus, the integrating interval should preferably be chosen 
as the interval covered by the extremes of the considered set of spike trains. 

We have introduced localized versions of our metrics, which, depending on the 
localization kernel J*?, could have a biologically-relevant interpretation of measur- 
ing the differences between two spike trains as they are perceived at a particular 
moment in time by a neuron receiving these spike trains. 

6 Conclusion 

In conclusion, we have introduced here a new class of spike train metrics, in- 
spired by the Pompeiu-Hausdorff distance. The max-metric and the modulus- 
metric show a higher sensitivity than existing metrics to the precise timings of 
spikes in the considered spike trains. The modulus-metric does not depend on 
any parameters and can be computed using a fast algorithm. All these suggest the 
modulus-metric as a preferred metric when there is a need to measure differences 
between two spike trains. 
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Appendix 

A Equivalent Hausdorff form 

Proposition A.l. The Pompeiu-Hausdorff metric 

h(T,T) = sup\d(x,T)-d(x,T)\ (35) 
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can be equivalently expressed as 

h(T,T) = sup \d{x,T)-d(x,T)\. (36) 
xe[a,b] 

Proof. We need to show that restricting the interval in Eq. 35 is acceptable since 
the supremum is achieved on the interval [a, b]. 

We first consider x e (-00, a]. Because V teT, x< a< r (1) < t, we have d{x, T) = 
t m - x and d{a, T) = t m - a. Because V f e 7", x<a< i m < t, we have d[x, T) = 
t m - x and d{a, t) = i m - a. Thus 

sup \d(x,T)-d(x,f)\= sup |(f (1) -x)-(f (1) -x)| = |r (1) -r (1) | (37) 

jc£(— 00, a] x£{-oo,a] 

sup \d{x, T) - d[x, f)\ = \d{a, T) - d{a, f)\ . (38) 

x£ (— 00, a] 

Analogously, for x e [b,oo) we have 

sup \d{x,T)-d{x,f)\ = \d{b,T)-d{b,f)\. (39) 

x£[b,oo) 



From Eqs. 38 and 39, 



sup \d{x, T) - d[x, T)\ — sup \d(x, T) - d(x, T}\ . (40) 

.ieR x£[a,b] 

□ 



B Analysis of the max-metric 

Proposition B.l. d m {T, f) < 00. 

Proof. From Eq. 8, for every x e [a, b] we have 

\d{x,T)-d{x,f)\<h(T,f). (41) 
Multiplying by J€ (•), which is positive, we obtain, Ms e [a, b], 

\d{x,T)-d{x,f)\ je{\s-x\) < h{T,T)J£'{\s-x\). (42) 
By taking the supremum and integrating, the equation above becomes 

rb rb 

I sup {\d{t,T)-d{t,f)\ je{\s-x\)}As< I sup {h(T, T) .X Qs- x\)} ds. (43) 

Ja x£[a,b] Ja x£[a,b] 

The left side of the equation above is the max-metric d m (Eq. 15). Because h{T, f) 
is independent of 5 and x, 

d m {T,T) < h{T,T) I sup Jf{\s- x\)ds. (44) 



) [ sup 

Ja x£[a,b] 



Since h{T, T) < b— a and J€ (y) < m, Vy e [0, b— a] (Eq. 12), we obtain 

d m {T,T)<(b- a) 2 m< 00. (45) 

□ 
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Proposition B.2. d m : x SP [aM 

Proof. In order to show that d m [-,-) is a metric we need to prove that it is non- 
negative, that d m [T, T) — o T - t for any T, f e &[a,b]> that is symmetric, and 
that it satisfies the triangle inequality. 

It is trivial to show that d m {T, t) is non-negative, symmetric, and that if T = 

T=>d m {T,T) = o. 

In order to prove that d m (T, T) = => T = f we use a reductio ad absurdum 
argument. Assume that d m {T, T) - with T ^ T. Then, there must be at least one 
spike in one of the two spike trains that is not in the other. Consider that this spike 
belongs to T; in the case that it belongs to f, the proof is analogous. Let u be the 
timing of this spike, ueT\f. Because u e [a, b], we have, Vs e [a, b], 

sup {\d(x,T)-d{x,t)\je{\s-x\)}>\d{u,T)-d{u,t)\je{\s-u\). (46) 

x£[a,b] 

Because ueT, d[u, T) = 0. Thus 

sup {\d{x,T)-d{x,T)\je{\s-x\)}>d{u,T)je{\s-u\). (47) 

xE[a,b] 

By integrating the equation above, we obtain 

d m (T,T)>d(u,T) f J?(\s-u\)ds. (48) 

J a 

Because utT, d[u, f) > 0. Also considering Eq. 9, we have 

d(u,T) f J^[\s-u\)ds>0. (49) 



Thus, from Eqs. 48 and 49, d m {T, T) > 0. Since we considered that d m {T, f) = 0, this 
cannot be true. Hence, T cf. Likewise, one can show that TqT and so T = T. 
In order to prove the triangle inequality, consider T e Sf\a,b\ ■ We have, Vx e U, 

\d{x, T) - d(x, t) + d{x,f)-d{x,T)\<\d{x,T)-d{x,t)\ + \d{x,f)- d{x, f)\. (50) 

Because sup^/Xx) + g(x)) < sup x {f {x)) + x [g{x)) for any two functions / and g, 
it follows that 

sup {\d{x,T)-d{x,T)\je{\s-x\)}< sup {\d{x, T)-d{x, t)\ JPQs-x\)} + 

x£[a,b] x£[a,b] 

sup {\d[x,t) - d{x,t)\ jPQs-x\)}. (51) 

x£[a,b] 

After integration, it results that 

d m [T,T)<d m {T,t) + d m (t,T). (52) 

With this final equality we have shown that the distance is indeed a metric and 
the proof ends. □ 

Proposition B.3. The metric d m : £f\ a ,b\ x Sf\a,b\ ~ * ^ ' s topologically equivalent to 
the Pompeiu-Hausdorff distance. 
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Proof. In order to show that the metrics d m and h are topologically equivalent 
it is sufficient to prove that the identity function i&> [(tb] '■ {■5P[a,b]'dm) — * [^[a.b]'^' 
i&[ ab] (T) = T and its inverse are both continuous (O'Searcoid, 2007, p. 229; Deza 
and Deza, 2009, p. 12). 

We first show that i#> [a b is continuous, which is equivalent to: V T e Sf\a,V\ , V e > 
0, 3 5(e) > such that V T e Sf [aM with d m {T, T ) < 5 we have h{T, T) < e. We 
choose 5(e) = e A(T, T) with 

A(T,T) = inf [ M'Qs-tUds. (53) 

KTuTJa 

From Eq. 9, we have that A[T, f) > 0. From Eq. 15, for all t e T, 

d m (T,f)> f \d(.t,T)-d{t,T)\je{\s-t\)&s (54) 

J a 

d{t,T)je{\s-t\)ds (55) 
rb 

d{t,T) inf I Jf{\s-t'\)ds (56) 



J (I 



and thus 



rb 

d m (T,T)> sun d(t,T) inf / J?(\s- t'\) ds (57) 

KT t'cTja 

rb 

d m (T,T) > sup d(t,T) inf I J€{\s- t'\) ds. (58) 
teT t'aTufJa 



teT 

Analogously, for all teT, 

■ h 

d(i, T) inf / 

teT 

Taking the max value in Eqs. 58 and 59 we obtain 



rb 

d m (T,T)> sup d(t,T) inf JPQs- ds. (59) 

- te f t'ETuTJa 



d m (T, T) > max-j sup d{t, T), sup d{t, T) i- inf f je{\s- ds. (60) 



From Eq. 6 it follows that 



"Ja 



d m {T, T) > h(T, T) inf / je (\s- t\) ds. (61) 

KTuT J 

Because e ^4(7", f ) = 5(e) > d m [T, f), from the last equation we have that e A{T, t) > 
h{T, f) A{T, t). Thus h{T, f ) < e since ,4(T, f ) > 0. 

It remains to show that is continuous, which is equivalent to: V T e £^[ a ,b] , V e > 

0, 3 5(e) > such that V f e SP {aM with h(T, f ) < 5 we have d m (T, f) < e. We 
choose 5(e) = elB{a, b) with 



B[a,b)= f sup ^f(|s-x|)d5. 



(62) 

jce[a,&] 
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We have 



B{a,b)> sup f J?(\s-x\)ds. 

xc[a,b]Ja 



Considering Eq. 9, we have B{a, b) > 0. From Eq. 15 we have 



J a 



d m (T,T)<l sup \d(x, T) - d{x, T)\ sup JF{\s-x\)ds 



XE[a,b] 



x£[a,b] 



d m (T,T)< sup \d[x, T) - d[x, T)\ J sup ^CQs — x\)ds. 

x£[a,b] J a x£{a,b] 



From Eqs. 8 and 63 we have 



d m {T,f)<h{T,f)B{a,b). 



(63) 

(64) 
(65) 

(66) 



Since h(T, t) < S{e) = e/B{a,b) and B{a,b) > 0, we get h(T, f) B{a,b) < e and, fi- 
nally, d m {T, T) < e. □ 



C Analysis of the convolution max-metric 

Lemma C.l. Let g : [a, b] — ► R be a continuous function and h : [0, b - a] — » U be 
a continuous function which is derivable on {0,b- a) and has bounded derivative. 
Then the function q: [a,b] — ► U, 



q{s)= sup [g{x) h{\s- x\)] 



(67) 



x£[a,b] 



is continuous on [a, b] . 



Proof. Consider sq e [a, b}. We need to show that V e > 0, 3 <5(e) > such that Vse 
[sq - 5, sq + S) |~| [a, b] , we have 



sup [g{x)h(\s-x\)]- sup [g{x)h{\s -x\)] 

x£[a,b] x£[a,b] 



< e. 



We have 



g(x) h(\s-x\)-g(x) h{\s -x\) < \g(x) h{\s-x\)- g{x) h{\s -x\)\ 
g{x) h{\s-x\)<\g(x) [h{\s-x\)-h{\s -x\)]\+g{x) h{\s -x\) 
g{x) h{\s-x\) < \g{x]\ \h{\s-x\)-h(\s -x\)\ + g(x) h{\s -x\). 



(68) 



(69) 
(70) 
(71) 



The function g is bounded since it is continuous on a compact interval (Protter, 
1998, p. 56). We denote by M the bound of the absolute value of g, i.e. |g(x)| < M, 
Vx e [a, b]. We denote by L the bound of the absolute value of the derivative of h, 
i.e. \h{x)-h{y)\<L\x-y\, Vx,ye [0,b-a]. Let e > and S = el(ML). Then for all 
se {sq-S, so + 5)D[a, b], 



\H\s- x\)- h{\s - x\)\ < L \ \s-x\ - \s -x\\ 
\g{x)\\h{\s-x\)-h{\s -x\)\<ML\\s-x\-\s -x\\. 

From Eqs. 71 and 73, 

g{x) h{\s-x\)<ML \\s-x\-\sQ-x\\ + g{x)h{\sQ-x\). 



(72) 
(73) 



(74) 
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Because V u, v e K we have 1 1 u| - 1 1;| | < | u - i/| , it follows that 

gW Wl*-*l) £ ML |s - s | + g(x) h{\s - x|). (75) 
Because |s-so| <S = el{M L), 

g(x) H\s-x\) <ML^-^ + g(x) h(\s - x\) 

= e+g{x)h{\s -x\). (76) 
Applying supremum to the equation above we obtain 

sup [g{x)h{\s-x\)]<e+ sup [g(x) h{\s - x\)] . (77) 

xc[a,b] xc[a,b] 

It follows that 

sup [g{x) h{\s- x\)]- sup [g{x)h(\s -x\)]<e. (78) 

x£[a,b] x£[a,b] 

Analogously, by switching s and sq in Eq. 69 and the ensuing equations, we get 

sup [g[x) h{\s -x\)] - sup [g{x) h(\s-x\)]<e. (79) 

xe[a,b] xE[a,b] 

Thus we have proved Eq. 68 and the proof ends. □ 
Proposition C.l. d c {T, T) < oo. 

Proof. Because J£ is positive (Eq. 18) we have / > and / > 0. Moreover, Vx e U, 
\f[x) - f[x) | < |/(x)| + |/(x) I = fix) + fix) 

n h 

|/(x) -/(x)| < Y^Xix- t m ) + Y J X{x- f (0 ). (80) 

i=l i=l 

Since ,X{x) < p, V xeU (Eq. 18), 

\f(x)-f{x)\<p{n+n). (81) 

From Eq. 22, 



d c {T,T)<\ sup |/(x)-/(x)| sup ^(|s-x|)ds (82) 

x£[a,b] x£[a,b] 



: sup \f0 

Ja x£[a,b] 

d c {T,T)<p{n+n) f sup (|s- x|) ds. 

J a x€[a,b] 



(83) 



Because J€ (y) < m, V y e [0, b- a] (Eq. 12), it follows that 

d c {T,T)<p{n+n){b-a)m<oo. (84) 



□ 



Proposition C.2. d c : £f\ a ,b\ x ^[a,b] ~~ > ^ + is a metric. 
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Proof. In order to show that d c {-,-) is a metric we need to prove that it is non- 
negative, that d c [T, f) — o T - T for any T, T e Sfi[ a ^, that it is symmetric, and 
that it satisfies the triangle inequality. 

It is trivial to show that d c {T, f) is non-negative, symmetric, and that if T = 
T => d c {T, T) — 0. In order to prove that d c (T, t) — => T — T we use a reductio ad 
absurdum argument. Assume that d c {T, T) = with T ^ f. For s £ [a, b] let 

sup {|/(x)-/(x)| Je{\s-x\)}. (85) 

jce[a,b] 

Because |/(x) - f[x) \ is continuous, from the properties of J€ and Lemma C.l we 
obtain that q is continuous. Because of the properties of .X ', T # f 3 x e [a, b] 
such that f{x) ^ fix); and because J€ is strictly positive, it follows that q is not 
zero everywhere, 3x e [a,b] such that qix) > 0. Because q is continuous, it follows 
that 

-b 

(86) 



d c (T,T)= [ qis)ds>0 

J a 



which contradicts the hypothesis that d c iT, T) = 0. Hence, T - T. 

In order to prove the triangle inequality, consider f e £P{ a ,b\- We have, \/x,s e 
[a, b], 

\fix) - fix) + fix) - fix)\ Jei\s-x\) < (|/(x) - fix)\ + \fix) - fix)\) J€i\s-x\). 

(87) 

Because sup s (g(s) + his)) < sup s (g(s)) + sup s (fa(s)) for any two functions g and h, it 
follows that, Vse [a, b], 

sup {\fix)-fix)\j£>i\s-x\)}< sup {\fix)-fix)\j£>i\s-x\)} + 

x£[a,b] x£[a,b] 

sup {|/(x)-/(x)| Je\\s-x\i\. (88) 

x€[a,b] 

After integration, it results that 

d c iT,T)<d c iT,f) + d c if,T). (89) 

With this final equality we have shown that the distance is indeed a metric and 
the proof ends. □ 

D Analysis of the localized max-metric 

Proposition D.l. rf/(T, f) < oo. 
Proof. For every se [a,b] we have 

hiT,f)= sup \dix, T) - dix, f)\ 

x£[a,b] 

> sup \dix,T)-dix,f)\ (90) 

xe[s,b] 

hiT,t)££ib-s)>S£ib-s) sup \d[x, T)-d[x, f)\. (91) 

x£[s,b] 

By integrating the last equation above, we obtain 



r r 

I S£ib-s) sup \d{x,T)-dix,T)\ds<hiT,T) \ &ib-s)ds. 

Ja x£[s,b] Ja 



(92) 



26 



Since h{T,T) < b- a and ££ (y) < m, Vye [0,b- a] (Eq. 24), it follows that 

di{T,f)<m(b-af<oo. (93) 

□ 

Proposition D.2. : ^j fl ,b] x £^\a,b\ — ' IK + is fl metric. 

Proof. In order to show that d/(-,-) is a metric we need to prove that it is non- 
negative, that di{T,t) - Q o T - t for any T, f e =5^ a ^], that it is symmetric, and 
that it satisfies the triangle inequality. 

It is trivial to show that d;(T, t) is non-negative, symmetric, and that if T — f => 
rf/(T,f)=0. 

In order to prove that di[T,T) — => T = T we use a reductio ad absurdum 
argument. Assume that di{T,T) — with T ^ T. Then, there must be at least one 
spike in one of the two spike trains that is not in the other. Consider that this spike 
belongs to T; in the case it belongs to f, the proof is analogous. Let u be the timing 
of this spike, ue T\T. 

First, we consider the case u > a. We have, Vs e [a, u], 

sup \d{x,T)-d{x,t)\>\d{u,T)-d{u,t)\. (94) 

X£[S,b] 

Because ue T\f, d{u, T) — and d[u, f) > 0. Thus, 

sup \d{x,T)-d(x,T)\>d[u, T). (95) 
x£[s,b] 



Multiplying by J*f (•) and integrating the above equation, we obtain 

I 5£{b-s) sup \d[x,T) - d{x,t)\ ds>d{u, f) I ££{b-s)ds. 



(96) 



x£[s,b] 

Because 



I 



X£[S,b] 

from Eq. 28 we have 



b 

5£{b-s) sup \d(x,T)-d(x,f)\ ds>0, (97) 



di(T,f)>[ S£[b-s) sup \d{x,T)-d{x,f)\ ds (98) 

Ja x€[s,b] 



(u, T) [ 
Ja 



d l {T,f)>d{u,t) ££{b-s)ds. (99) 



Because 5£ is strictly positive on (0, b-a] and continuous, we have f" !£ [b- s) ds > 
0. Because we have d{u, t) > 0, we get 

d/(r,f)>0. (100) 

Since we have considered di(T, T) = 0, it follows that Eq. 100 cannot be true. Hence, 

rcf. 

Second, we consider the case u — a. Let v be the timing of the first spike in 
either T or f, other than u. Since T ^ t, v > u. Because 



I 



b 

i£(b-s) sup \d{x,T)-d{x,T)\ ds>0, (101) 

(u+v)l2 x£[s,b] 
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from Eq. 28 we have 

Mu+v)l2 

di(T,t)>\ &(b-s) sup \d(x,T)-d(x,T)\ ds (102) 

J a x£[s,b] 
n(u+v)/2 

di(T,t)>\ 5£{b-s) sup \d{x,T) - d{x,t)\ ds. (103) 

J a x£[s,(u+v)l2] 

For all xe [u,{u + v)l2) we have d(x, T) = x-u, d{x, f)> v- x, and because on this 
interval v - x > x - u, we have \d{x, T) - d{x, T) \ > 0. Because is strictly positive 
on (0, b— a], we get 

-(u+v)l2 



J a 



5£{b-s) sup \d{x,T)-d{x,f)\ ds>0 (104) 

xe[s,(u+y)/2] 



and thus 

di(T,T)>0. (105) 

Since we have considered di(T, f) = 0, it follows that Eq. 105 cannot be true. Hence, 
TQT. 

Thus, we have shown that in both the case u > a and the case u-awe have 
Tcf. Likewise, one can show that fc I and so T = f if di{T, t) — 0. 

In order to prove the triangle inequality consider T e £f\ a ,b\- We have, Vx g 
la, b], 

\d{x, T) - d(x, f) + d{x, f) - d{x, T)\ < \d{x, T) - d(x, f)\ + \d{x, t) - d(x, T)\. (106) 

Because sup^gfx) + h[x)) < sxrp x {g[x)) + sup x (/j(x)) for any two functions g and h, 
it follows that, Vs e [a, b], 

^£{b-s) sup \d{x, T)-d{x, T)\ <££{b-s) sup \d{x, T) - d{x, f) \ + 

X£[S,b] XE[S,b] 

££{b-s) sup \d{x,f)-d{x,t)\. (107) 

X£[S,b] 

After integration, it results that di(T, T) <di(T,f) + di{f, T). 

With this final equality we have shown that the distance is indeed a metric and 
the proof ends. □ 



E Analysis of the localized modulus-metric 

Proposition E.l. d n [T, f ) < oo. 
Proof. From Eq. 8, we have, Ms e [a, b], 

h{T,T)>\d{s,T)-d{s,T)\. (108) 
Multiplying by ££{■), which is positive, we obtain 

h{T, t)££{b-s)>££{b-s) \d[s, T)-d{s, f)|. (109) 
By integrating the above equation, we obtain 



pb rb 

r,T) / ^(b-s)ds> 

Ja J a 



h(T,T) i£(b-s)As>\ 5£{b- s) \d(s,T) - d{s,T)\ ds. (110) 
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Since h{T, f)<b-a and ££{x) <m, Vxe [0, b - a] it follows that 



d n {T,f) < m{b- af <oo. (Ill) 

□ 

Proposition E.2. d n : £f\ a ,b\ x ^[a,b\ ~* ^ + is a metric. 

Proof. In order to show that d n {-,-) is a metric we need to prove that it is non- 
negative, that d n (T, T) = o T = T for any T, f , that it is symmetric, and that it 
satisfies the triangle inequality. 

Let T, f £ Sf[a,b]- It i s trivial to show that d n {T, f) is non-negative and symmet- 
ric, and that T = f => di{T, f ) = 0. In order to prove the converse we use a reductio 
ad absurdum argument. Assume T # T with d n {T, t) = 0. For s e [a, b] let 

q{s) = 5e{b-s) \d(s,T)-d{s,T)\. (112) 

Because \d{s, T) - d{s, f)| is continuous and 5£ is continuous it results that q is 
continuous. Because T ^ T => 3 s e [a, b] such that d{s, T) ^ d{s, T); because i£ is 
strictly positive on (0, b- a], it follows that q is not zero everywhere, 3s e [a, b) such 
that q{s) > 0. Because q is continuous, it follows that 



in(T,T)= f L 

Ja 



g(s)ds>0 (113) 



which contradicts the hypothesis that d n {T, T) = 0. Hence, T=T. 

In order to prove the triangle inequality consider f e S?\ a ,b\ ■ We have, Vs £ U, 

\d(s, T) - d{s, f) + d(s, f) - d{s, T)\ < \d(s, T) - d(s, f)\ + \d(s, f) - d{s, T)\. (114) 

Multiplying by 5£ (•) and integrating the above equation, we obtain 



/ 

J a 



d{s,T)-d(s,T)\ ^£{b-s) ds< 

rD rb 

\ \d{s,T)-d{s,t)\^£{b-s)As+ \ \d{s, f) - d(s, T)\ 5£ (b- s) As (115) 

Ja Ja 

It results that 

d„{T,f)<d n (T,f) + d n {f,f). (116) 

With this final inequality we have shown that the distance is indeed a metric and 
the proof ends. □ 
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